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Robert  J.  Jannaront,  James  E.  Laughlin  and  Kai  F.  Yu 


Abstract 

A  Bayes  estimation  procedure  is  introduced  that  allows  the  nature  and  strength  of  prior  beliefs 
to  be  easily  specified  and  posterior  models  to  be  estimated  with  no  more  difficulty  than  maximum 
likelihood  estimation.  The  procedure  is  based  on  constructing  posterior  distributions  that  are  formally 
identical  to  likelihoods,  but  are  constructed  partly  from  sample  data  and  paiUy  from  artificial  data 
reflecting  prior  information.  Improvements  in  performance  of  modal  Bayes  procedures  relative  to  max¬ 
imum  likelihood  estimation  procedures  are  illustrated  for  Rasch-type  models.  Improvements  range 
from  modest  to  dramatic,  depending  on  the  model  and  the  number  of  items  b'  ing  considered. 
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Easy  Bayes  Estimation  for  Rasch-Type  Models 


Introduction 

Scope.  Augmenting  observed  data  by  artificial  observations  has  been  used  informally  for  some 
time  to  solve  certain  estimation  problems.  For  example,  adding  observations  to  empty  cells  in  con¬ 
tingency  tables  was  recommended  over  35  years  ago  (Rao,  1952)  in  order  to  make  joint  categorical 
probabilities  estimable.  Artificial  data  augmentation  has  also  been  recognized  as  a  useful  and  general 
device  for  incorporating  prior  beliefs  (Jackson  &.  Novick,  1974).  Of  more  direct  interest,  Wright  (1980) 
recommended  adding  artificial  item  scores  to  individuals’  Rasch  model  test  scores,  in  order  to  obtain 
latent  trait  estimates  for  individuals  who  pass  all  items  or  fail  all  items.  Although  he  did  not  justify 
the  approach  formally,  Wright  also  suggested  that  adding  such  artificial  observations  to  data 
corresponds  to  imposing  a  kind  of  Bayes  prior.  In  a  recent  article,  Tanner  and  Wong  (1987)  made  a 
more  formal  connection  between  artificial  data  augmentation  and  Bayes  theory’-  They  described  a  class 
of  corresponding  estimation  procedures  as  well.  This  article  describes  and  justifies  a  new  data  augmen¬ 
tation  Bayes  approach  to  Rasch-type  model  estimation  that  has  statistical  and  computational  advan¬ 
tages  over  existing  methods.  The  Bayes  approach  may  also  be  used  to  reflect  prior  beliefs  for  Rasch 
and  other  exponential  family  modeb,  in  ways  that  may  usefully  supplement  exbting  methods. 

Existing  Bayes  methods  for  Rasch-type  modeb  each  have  their  liabilities.  Since  the  Rasch  model 
belongs  in  the  exponential  family,  conjugate  prior  and  posterior  distributions  may  easily  be  found 
(Bickel  tic  Doksum,  1977).  However,  obtaining  satisfactory  estimates  such  as  posterior  means  or  poste¬ 
rior  modes  b  often  not  easy.  The  same  seem^  true  of  Bayes  and  empirical  Bayes  estimates  in  test 
theory  (Mblevy,  1986;  Tsutakawa  &  Lin,  1986)  as  well  as  those  described  by  Tanner  &  Wong  (1987). 
Also,  although  the  method  described  by  Wright  seems  quite  simple  the  method  b  not  justified,  espe¬ 
cially  in  terms  of  a  precbe  Bayes  formulation.  Empirical  Bayes  approaches  have  already  been  sug¬ 
gested  that  incorporate  "auxiliary"  information  into  item  response  modeb  (Mislevy,  1986;  Swam- 
inathan  &  Gifford,  1981,  1982  and  1985).  The  Bayes  approach  described  here  differs  from  these 
methods  in  three  ways.  First,  in  the  Bayes  procedure  we  explicitly  design  our  priors  to  incorporate  a 
minimal  degree  of  auxiliary  information.  In  contrast,  the  amount  of  prior  information  that  empirical 
Bayes  approaches  attribute  to  the  prior  b  dictated  by  the  data  and  can  be  substantial.  Second,  as  with 
exbting  Bayes  and  empirical  Bayes  approaches  we  assume  exchangeability  across  relevant  model 
parameters.  In  contrast,  however  we  explicitly  state  an  a  priori  modal  value  for  the  exchangeable 
parameters  in  a  way  that  clearly  identifies  the  model.  Finally,  because  we  utilize  a  particular  class  of 
conjugate  priors  we  end  up  with  posteriors  in  the  same  form  as  the  likelihood.  Thus,  we  easily  obtain 
posterior  modal  estimates  by  making  minor  modifications  to  exbting  maximum  likelihood  (ML)  esti¬ 
mation  programs. 

Purpose.  The  purpose  of  this  article  b  to  describe  and  justify  a  method  for  easily  incorporating 
prior  information  through  data  augmentation,  by  (a)  deriving  the  method  as  a  posterior  modal  pro¬ 
cedure,  given  certain  conjugate  structures;  (b)  illustrating  the  method’s  use  for  some  Rasch-type  situa¬ 
tions;  and  (c)  demonstrating  how  the  method  can  be  used  to  considerably  improve  parameter  estima¬ 
tion. 

An  informal  overview  and  result  summary  will  be  given  below.  Technical  details  will  be 
described  later. 

Overview.  We  will  begin  by  applying  the  model  to  the  familiar  Rasch  case,  which  leads  to  mod¬ 
est  estimation  improvements.  We  will  then  consider  more  impressive  improvements  based  on  two  less 
familiar  models. 

When  estimating  parameters  for  the  Rasch  model,  problems  due  to  sufficient  statistics  taking  on 
boundary  values  can  occur  if  test  lengths  are  small  and/or  observed  score  dbtributions  are  skewed.  In 
such  cases  a  substantial  proportion  of  individuals  may  fail  all  items  or  pass  all  items,  in  which  case 
their  latent  trait  values  will  not.  be  estimable.  Losing  such  individuals  can  lead  to  deflated  correlations 
between  estimated  latent  traits  and  other  variables,  because  latent  trait  estimates  based  on  extreme 
scores  will  be  excluded.  In  addition,  biased  estimates  of  item  parameters  may  result,  because  the  same 
individual  latent  trait  estimates  will  not  be  available  for  simultaneous  item  parameter  estimation  (and 
consequently  estimated  latent  trait  distributions  may  become  distorted).  Similar  problems  may  also 
occur  when  item  parameter  sufficient  statistics  take  ori  boundary  values,  which  can  occur  occasionally 
when  sample  sizes  are  small. 


An  easy  way  to  remove  such  problems  is  to  augment  observed  data  with  artificial  data  such  that 
resulting  sufficient  statistics  cannot  take  on  boundary  values.  For  example,  suppose  that  data  were 
available  from  a  (binary)  G-itein  test  and  that  scores  from  two  additional  items  were  added  to  each 
individual  s  item  score.  Suppose  further  that  for  each  individual  exactly  one  augmented  item  score 
was  coded  "pass"  and  exactly  one  was  coded  "fail".  The  resulting  augmented  data  would  yield  test 
scores  from  1  to  7  on  an  8-item  test  instead  of  scores  from  0  to  6  on  a  6-item  test,  with  each  individual 
having  number-correct  scores  augmented  by  1.  Thus,  if  augmented  data  were  used  instead  of  the  raw 
data  for  individual  parameter  estimation,  the  boundary  values  would  disappear.  (Using  such  an 
approach  to  avoid  estimation  problems  of  course  raises  questions  including  whether  or  not  the  pro¬ 
cedure  is  formally  justified,  how  augmented  item  parameters  should  be  treated,  and  the  extent  to 
which  resulting  estimates  could  be  distorted.  Such  questions  will  be  addressed  later—  for  now  only  the 
mechanics  and  global  results  of  the  approach  will  be  described.) 

The  first  part  of  Table  1  indicates  the  kinds  of  improvements  in  correlations  between  true  and 
estimated  latent  traits  that  the  above  kind  of  data  augmentation  can  yield.  As  indicated,  all  improve¬ 
ments  are  modest  and  are  evident  only  in  cases  involving  small  numbers  of  items.  M.  Also,  although 
reliability  improvements  (that  can  be  obtained  by  computing  square  roots  of  the  Table  1  entries)  are 
greater,  they  are  still  modest.  In  addition,  only  a  small  proportion  of  individuals  will  be  recovered  by 
the  data  augmentation  approach,  unless  M  is  small.  For  example,  the  proportion  of  recovered  indivi¬ 
duals  corresponding  to  /  values  of  1.000  in  Table  1  were  .093,  .026,  and  .004  for  additive  Rasch  models 
based  on  6,  10.  and  20  items,  respectively.  Thus,  only  minor  improvements  seem  likely  for  the  Rasch 
model,  unless  A/  is  small  and  strong  floor  or  ceiling  effects  are  present. 

The  next  example  leads  to  considerably  more  dramatic  improvements,  because  it  yields  much 
more  frequently  occurring  boundary  values.  In  a  recent  attempt  to  reflect  individual  differences  in 
learning  abilities,  J&nnarone  (1987)  has  developed  a  family  of  so-called  Markov  item  response  models. 
One  of  these,  called  the  bivariate  Rasch  Markov  (BRM)  model,  differs  from  the  usual  Rasch  model  in 
that  two  individual  parameters  are  involved  instead  of  only  one.  One  parameter,  qr,  is  analogous  to  the 
usual  Rasch  ability  parameter  in  that  its  sufficient  statistic  is  the  number-correct  score  for  a  given 
individual.  The  second  parameter,  6,  reflects  individuals’  abilities  to  learn  and  apply  new  information 
to  subsequent  items.  The  second  parameter’s  sufficient  statistic  is  the  number  of  times  an  individual 
passed  item  n  as  well  as  item  n+1  (n  —  1  ,  .  .  .  ,  M-l). 

Figure  1(b)  indicates  the  possible  contingencies  for  individuals’  sufficient  statistics,  given  a  10- 
item  test  satisfying  a  BRM  model.  All  possible  contingencies  lie  either  on  or  inside  the  dark  gray  per¬ 
imeter.  As  indicated,  it  is  never  possible  for  the  6  sufficient  statistic,  d,  to  be  as  large  as  the  q  sufficient 
statistic,  g.  For  example,  at  most  4  distinct  adjacent  pairs  of  items  could  be  passed  if  only  5  total 
items  were  passed.  Adjacent  cross-product  scores  also  restrict  number-correct  scores.  For  example,  if 
only  3  adjacent  pairs  of  items  were  passed  then  no  more  than  8  items  in  a  10-item  test  could  be  passed 
(otherwise  more  than  3  pairs  would  have  necessarily  been  adjacent). 

Besides  unusual  contingency  restrictions  for  the  bivariate  Rasch  Markov  case,  unusual  boundary 
values  occur  as  well.  For  example,  if  g  were  8  then  the  lower  and  upper  boundary  values  for  d  would 
be  5  and  7,  respectively.  Moreover,  such  boundary  values  do  not  iiave  finite  MLE’s.  just  as  sufficient 
statistic  values  of  0  and  A/  in  the  Rasch  case  do  not  have  finite  MLE’s.  Consequently,  all  such  boun¬ 
dary  values  are  inestimable.  Similarly,  the  smallest  and  largest  g  values  for  fixed  d  values  are  also  ines¬ 
timable.  .Ml  such  inestimable  cells  for  the  10-item  case  are  indicated  by  dark  gray  squares  in  Figure 
1(b).  Likewise,  all  inestimable  cells  for  the  17-item  case  are  indicated  by  light  grav  squares  in  Figure 
1(a). 

.As  Figures  1(a)  and  (b)  indicate,  many  cells  are  inestimable  for  BRM  cases— many  more  than  for 
the  Rasch  case.  Consequently,  much  larger  proportions  of  individuals  must  be  excluded  than  in  the 
Rasch  case.  For  example,  in  the  Table  1  bivariate  Markov  simulations  with  /  values  of  1.000  and  A/ 
values  of  6,  10.  and  20.  the  proportions  of  randomly  generated  individuals  that  were  excluded  from 
ML  estimation  were  .949,  .745.  and  .354.  respectively. 

The  boundary  problem  can  be  solv'  d  for  the  BRM  can  in  much  the  same  way  as  in  the  Rasch 
case-by  augmenting  individuals'  observed  test  scores  with  artificial  item  scores.  In  the  BRM  case,  the 
minimal  raw  score  augmenting  solution  entails  adding  7  items  to  all  individuals’  test  patterns,  such 
that  each  g  value  becomes  augmented  by  3  and  each  d  value  becomes  augmented  by  1.  The  conse¬ 
quence  of  one  such  augmentation  is  illustrated  in  Figure  1(c)  for  the  10-item  case.  As  indicated  all  of 
the  original  10-item  contingencies  will  occur  within  the  ’7-item  boundary  values.,  once  they  have  been 
augmented  by  artificial  data  in  this  way. 


Table  1* 


True-Estimated  Individual  Parameter  Correlations 
For  Maximum  Likelihood  and  Bayes  Estimates.* 


Model 

Number 
of  Items  (  M ) 

Sample 
Size  (  / ) 

True  Score/Maximum- 
Likelihood-Estimate 
Correlation 

True  Score /Bay  es- 
Estimate 
Correlation 

Additive 

6 

100 

.63 

.66 

Rasch 

6 

1000 

.68 

.72 

10 

100 

.75 

.86 

10 

1000 

.79 

.82 

20 

100 

.87 

.86 

20 

1000 

.88 

.89 

30 

100 

.92 

.91 

30 

1000 

7 

.92 

.92 

Bivariate 

6 

100 

7 

.51 

Rasch 

6 

- 

.36 

Markov 

6 

1000 

7 

- 

.55 

S 

- 

.28 

10 

100 

7 

.16 

.68 

6 

.20 

.26 

10 

1000 

7 

.30 

.60 

6 

.33 

.38 

10 

5000 

7 

.33 

.61 

6 

.38 

.43 

15 

100 

7 

.23 

.63 

6 

.40 

.54 

15 

1000 

7 

.51 

.62 

6 

.54 

.51 

20 

100 

7 

.55 

.67 

6 

.53 

.55 

20 

1000 

7 

.59 

.67 

S 

.60 

.57 

‘Entries  are  product-moment  sample  correlations.  For  additive  cases  latent  trait  values  were  randomly 
sampled  from  5  points,  -2,  -1,  0,  1,  and  2,  having  (quasinormal)  probabilities,  .07,  .24,  .38,  .24.  and  .07. 
respectively.  For  bivariate  cases  latent  trait  values  were  randomly  sampled  from  25  points.  (-2.-2).  (- 
2.-1),  .  .  .  ,  (2,2)  such  that  marginal  probabilities  were  the  same  as  in  the  additive  case  and  the  two 
latent  traits  were  mutually  independent.  For  additive  Rasch  models  half  of  the  item  difficulties  were 
+  1  and  half  were  -0.5.  For  bivariate  Rasch  Markov  models  the  additive  item  parameters  were  1.0  and 
the  cross-product  item  parameters  were  -0.5.  estimates  were  obtained  by  a  Newton-Raphson 
approach  described  in  the  text  and  in  Jannarone  (1987).  For  both  models  all  (  Bayes  vs.  nonBayes  ) 
random  samples  were  obtained  independently. 


Figure  1. 


Individual  Sufficient  Statistic  Features  for  Bivariate 
Rasch  Markov  Tests  of  Length  10  and  17.* 


(a) 

cl 
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Figures  1(a)  and  (b)  correspond  to  M  =  17  and  M  =  10,  respectively.  For  both  Figures 
the  possible  fg.  d>  contingencies  include  boundary  values  that  are  shaded  a‘  well  as 
estimable  contingencies  that  are  unmarked  and  inside  the  boundary-value  perimeter. 
Contingencies  corresponding  to  1<  .vcrg  ! d )  bounds  arc  labelled  by  L's  at  the  bottom  (left 
side)  of  shaded  squares,  whereas  contingencies  corresponding  to  upper  g  idi  values  are 
labelled  by  L'  s  at  the  top  (right  side)  of  shaded  squares.  Figure  1  (c)  illustrates  how  the 
10-item  contingencies  would  all  lie  within  the  17-item  boundary  perimeter,  if  d ,  g.  and  A.' 
for  the  l(»-item  case  were  transiormen  to  d  - 1.  g  -*-3  and  M  -  7.  respective!' . 
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The  entries  in  the  bottom  of  Table  1  indicate  the  dramatic  improvements  in  validity  that  can  be 
expected  from  artificial  data  augmentation  for  the  BRM  case.  For  the  &-item  case  it  is  not  even  possi¬ 
ble  to  correlate  individual  parameter  MLE’s  with  other  variables  because  only  one  cell  is  estimable. 
For  other  cases,  improvements  in  both  q  and  6  estimates  are  strong,  even  for  moderate  M  values. 

Besides  solving  boundary  value  problems,  artificial  data  augmentation  can  be  easily  used  to 
impose  prior  structures  on  data  (Novick  £  Jackson.  1974).  For  example,  Jannarone,  Yu,  and  Takefuji 
(1987)  have  recently  developed  a  set  of  conjunctive  models  for  neural  and  machine  learning.  One  pur¬ 
pose  of  such  models  is  to  accurately  estimate  associations  between  one  (input)  binary  vector  and 
another  (output)  binary  vector  over  a  series  of  learning  trials.  In  each  learning  trial,  a  datum  consist¬ 
ing  of  joint  (input,  output)  values  for  the  vectors  is  presented  and  the  model  must  specify  how  much 
weight  to  give  the  learning  trial  datum,  relative  to  the  previous  learning  trial  data  and/or  "prior 
beliefs”.  A  detailed  description  of  the  mechanism  for  incorporating  such  learning  trial  weighting  is 
beyond  this  article’s  scope.  We  merely  mention  that  the  mechanism  corresponds  precisely  to  augment¬ 
ing  each  learning  trial  datum  with  "prior"  artificial  data.  The  data  augmentation  mechanism  for  that 
case  is  also  quite  easy  to  implement  and  interpret  .  One  of  the  simpler  models  that  could  be  used  this 
way,  called  the  Rasch  Markov  model  with  no  individual  differences,  will  be  described  in  the  next  sec- 


Regarding  distortions  that  could  arise  from  artificial  data  augmentation,  the  augmentation  pro¬ 
cess  corresponds  formally  to  a  Bayes  posterior  estimation  scheme,  as  will  be  shown  below.  Conse¬ 
quently.  the  process  can  lead  to  biased  estimates  just  as  any  Bayes  procedure  can  lead  to  biased  esti¬ 
mates.  However,  as  for  many  other  Bayes  procedures  the  bias  will  not  be  serious  in  that,  (a)  bias  in  the 
cases  that  we  consider  here  corresponds  to  a  uiyform  shrinkage  of  parameter  estimates  toward  some 
central  value;  (b)  the  Bayes  estimates  that  result  from  the  augmentation  process  will  always  be  mono- 
tonically  related  to  maximum  likelihood  estimates;  and  (c)  bias  levels  will  decrease  as  the  sample  sizes 
and/or  numbers  of  items  increase.  Moreover,  in  some  cases  incorporating  bias  through  such  data  aug¬ 
mentation  may  actually  be  helpful  toward  adjusting  item  parameter  estimates  that  are  known  to 
biased.  One  such  application  might  be  in  estimating  item  parameters,  for  example  see  (Samejima, 
1987). 

In  the  next  section  we  will  connect  artificial  data  augmentation  with  Bayesian  prior/posterior 
probability  structures.  Besides  pointing  toward  appropriate  estimation  schemes  and  proper  interpreta¬ 
tions,  the  results  to  follow  will  also  suggest  ways  that  data  augmentation  can  lead  to  model 
identification. 


Detailed  Description 

Conjugate  cases  for  exponential  families.  Although  the  following  approach  seems  to  have  gen¬ 
eral  utility,  only  observables  having  binary  elements  will  be  considered  here.  For  any  sample  consisting 
of  I  M  -variate  observations,  Xj,  .  .  .  ,X/,  and  having  a  likelihood  of  the  natural  exponential  family 
form, 


,x/  i  a  )  =  if(a);/exp{  V)  ar  £  sr(x,)},  x,-  €  B  i  =  1 . /, 


r  -  1  ;  -  1 


where  the 


L'Mx,-).  r  =  1 . & 


are  sufficient  statistics  corresponding  to  the  parameters  aIt  through  aK. 
f>  -1 

via)  -  V  exp{  V)  a,«r(u)} 

,efW  r  «=  i 


F‘=(u:ib=0.1.  rr,  =  1. 
A.'yj 


a  (possibly  improper)  conjugate  prior  density  is  given  ly 


fa  A../i  ::  i>  lo)  "exp;  V  u,A.\ 


r<iri:e.  i1.:  Doitsum.  1977.  Prop,  ffi.l— tin-  conjugate  prior  vih  i>c  proper  lor  a  given  A  and  if 
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J  [i<Q)]yexp{  E  arAr}da  <  oo.  ) 

a£«”  '■-1 

A  consequence  of  (1)  and  (2)  is  that  the  posterior  probability  function, 

h(a  lx,.  .  .  .  ,x/,  A,/)  =  L(x],  .  .  .  ,X/  I  a)f{a  IA  ,J) 

lx/? 

oc  i<a),+/exp{  V  ar{  V  «r(x,)+Ar)}  ,  (3) 

r  -  1  l-l 

has  the  same  parametric  from  as  (l),  that  is,  (3)  is  conjugate  to  (1).  For  example,  if  the  x,  satisfy  a 
Rasch  Markov  model  (Jannarone,  1987)  with  no  individual  differences,  then 


L(Xi - X/l/9  )  =  M/^eXp  +  E  A..-+1  E  I.nIk..+l  - 

1XJ2AY-1)  L-l  »_1  ,_i 


so  that  a  conjugate  prior  density  is  given  by, 


AP  1  B  ,J)  oc  H0)]'exp  2  0mQm  +  E  ^.+i^.+i  . 
lxp.M-1)  lm-1  «-i 


which  leads  to  the  posterior  probability  function, 

W  '*> . oc  [40)],+'exp(  E  /LL£  +  eV»+i(  E  TinXin+]+BB.nM)  •• 

m  —  1  '»«1  n  ■■  1  I  ■*  1  ( 

Conjugating  prior  dcneities.  Just  as  conjugate  prior  densities  have  the  same  parametric  form  as 
their  resulting  posteriors,  priors  may  be  constructed  such  that  their  likelihoods  and  posterior  probabil¬ 
ity  functions  have  the  same  parametric  form.  Such  priors  will  be  called  conjugating  because  they 
impose  conjugacy  between  posteriors  and  likelihoods  rather  than  between  posteriors  and  themselves. 
Conjugating  cases  are  particularly  interesting  when  resulting  posterior  probability  functions 
correspond  to  likelihoods  for  feasible  i.i.d.  samples.  In  the  sequel  we  will  restrict  the  meaning  of  conju¬ 
gating  to  include  only  priors  that  yield  such  feasible  "posterior  likelihoods". 

The  structure  of  (1),  (2),  and  (3)  suggests  a  simple  method  for  obtaining  conjugating  priors  for 
exponential  family  likelihoods.  For  a  given  likelihood  and  prior  satisfying  (l)  and  (2),  the  resulting  pos¬ 
terior  (3)  will  be  a  feasible  likelihood  from  the  same  family  as  (1)  if  7+/is  a  positive  integer  and  the 

/ 

E  a,(xf)  +  Ar 

i  -1 

are  feasible  sufficient  statistics  from  a  sample  of  size  I+J.  That  is,  for  a  Ijj^lihood  of  form  (2)  a  conju¬ 
gate  prior  of  form  (1)  will  also  be  conjugating  if  there  exist  zit  .  .  .  ,zj  E  B  such  that 

j 

-4,  =  E  *'(•;)’  r  =  i . R- 

/- 1 

(Similar  methods  have  been  suggested  previously  for  other  applications—  see  Novick  k  Jackson  1974.) 

One  useful  feature  of  conjugating  priors  is  the  ease  with  which  they  can  reflect  prior  informa¬ 
tion.  Conjugating  priors  can  be  imposed  such  that  the  strength  of  prior  belief  is  indicated  by  prior 
sample  sizes  and  the  nature  of  prior  belief  is  indicated  by  prior  sufficient  statistic  values.  Returning  to 
the  Rasch  Markov  example  with  no  individual  differences,  suppose  that  one  wished  to  combine  data 
with  the  prior  notion  that  the  elements  in  X  were  mutually  independent  and  identically  Bernoulli 
(0  5).  The  relative  degree  of  prior  belief  would  be  indicated  by  the  size  of  J  relative  to  I—  for  instance 
equal  prior  and  data  weightings  would  correspond  to  /  =  J.  The  nature  of  prior  beliefs  in  this  case 
would  correspond  to  setting  B  =  0.  (This  and  similar  cases  have  been  extended  in  neural  and 
machine  learning  settings  to  include  noninteger  values  for  J  within  the  context  of  "learning  trial 
weightings"—  see  Jannarone,  Yu,  k  Takefuji,  1987  for  details.) 

A  second  feature  of  conjugating  priors  is  the  ease  with  which  they  can  yield  posterior  estimates. 
First,  for  models  satisfying  (1)  unique  MLE's  exist  whenever  sufficient  statistics  are  not  boundary 
values.  Second,  provisions  for  obtaining  MLE's  are  available  in  many  such  cases  (including  the  Rasch 
Markov  case— Jannarone,  1987).  As  a  consequence  of  the  conjugating  property  such  procedures  may  be 
used  to  find  posterior  modes,  because  posterior  modes  are  formally  equivalent  to  likelihood  maxima 
given  the  conjugating  property. 


\m 


A  third  conjugating  prior  feature,  which  motivated  this  article,  is  the  potential  for  solving  prole 
lems  due  to  boundary-valued  sufficient  statistics.  As  a  first  example  consider  Rasch  model  estimation 
based  on  the  likelihood. 


.x,  i  0 

1  Xj' 


P  )  = 

1  xM 


n  {  n  (i+expR-^m  n  n  u. 


=  i{0,  P)cxp\  V1  0,-  V  x, 


where  0  and  ft  contain  individual  and  person  parameters,  respectively.  Parameter  estimation  |  tublcins 
arise  in  the  Rasch  case  when  sufficient  statistics  take  on  their  minimum  or  maximum  possible  values. 
Besides  leading  to  inestimable  individual  parameters  the  problem  can  also  lead  to  biased  item  parame¬ 
ter  estimates,  because  item  parameter  MLE’s  depend  on  individual  parameter  MLE's. 

A  conjugating  prior  for  solving  Rasch  model  boundary  problems  can  be  constructed  as  follows. 
(The  following  process  for  constructing  conjugating  priors  differs  slightly  from  the  conjugate-prior- 
based  example  given  previously  —although  the  process  yields  posteriors  that  are  also  formally 
equivalent  to  Rasch  likelihoods,  the  resulting  posteriors  will  be  based  on  different  numbers  of  items 
than  their  corresponding  likelihoods.)  By  setting 


f  [0.  P)  x  n  n  (1+expR})  exp!  D  (#,•)}  . 

i  -  1  n  «  '  i  -  I 

the  "posterior  likelihood"  takes  the  form, 


n  n  (i+exp {0,—  o}) 


ri  n  (i+exp {o,—pm}) 


exP  j  S  i  E  (°~  0)i+(tf<-  0)  o' j .  (-1) 

The  posterior  (4)  is  clearly  equivalent  to  a  likelihood  from  an  (M+2)-item  test,  with  each  individual’s 
observ  ed  M- item  score  augmented  by  a  score  of  1  on  a  subtest  based  on  two  additional  items,  each 
having  a  difficulty  of  0.  Thus,  the  prior  information  for  0  is  exchangeable  and  reflects  an  a  priori 
modal  estimate  of  zero.  Also,  the  weight  associated  with  this  prior  information  can  be  represented  by 
the  ratio  of  hypothetical  to  actual  test  items,  in  this  case,  2/M  The  prior  weight  is  minimal  in  that 
two  hypothetical  items  are  necessary  to  resolve  the  boundary  value  problem  in  the  Rasch  model. 

Interestingly,  the  difficulty  scale  becomes  implicitly  identified  by  the  prior  (4)  in  that  a  difficulty 
value  of  zero  is  associated  with  the  two  artificial  items.  (In  the  empirical  Bayes  procedures  cited  previ¬ 
ously  the  data  determine,  in  an  uncertain  way.  the  identification  of  the  difficulty  scale,  whereas  the 
usual  Rasch  model  requires  fixing  one  parameter  during  estimation  for  identifiability.) 

The  gradient  elements  for  the  logarithm  of  the  posterior  (4)  take  the  form. 
dL  ~  ‘  exp it'  t  - ' 

,r;  l-exp!f',— 


exp(&,— 3m] 
l-t-exp{6,-5„ 


2exp{P,-} 

l+cxp{f',} 


The  posterior  modal  estimate  (PME)  P  gradients  in  |e)  are  identical  to  the  usual  Rasch  model  log- 
likelihood  gradients  (Andersen.  1980).  Also  the  PME  0  gradients  in  (0)  are  identical  to  MLE  C  gra¬ 
dients.  except  individual  sufficient  statistics  are  augmented  i  1  1  and  two  additional  item  parameter.- 
are  involved,  each  having  0  -valued  parameters.  Thus.  Easci.  .  'ME  s  may  be  obtained  by  making  only 
minor  modifications  to  existing  Rasch  NC.E  procedures 

Tne  remainin':  PME  example,  whirl:  was  illustrat'  d  earlier  it:  Figure  .  impose.-  conjugating 
prior  structur-  ori  bivariate  Rasci.  Markov  per-  >i  parameter-  and  results  ii:  major  c*timatioi 
improvement-  I  or  this  case  ii(:eiihoo:i-  tai:<  tie  forn  .iannaronc.  lOM, 
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(minimally  informative  boundary-value  removing)  conjugating  priors  take  the  form, 


At  s<  A)  oc 

and  resulting  posteriors  are, 


/  7  e 

n  E,exp»  E  T-f-+  E  siv«t '«+!> 
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A (Tr,  5  I  L,  F)  oc 
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exp{  V  (3 0,+A)}  ; 
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A/— 1 


n  E  eXP^  E  (T-Am)«m+  E  (4~A»+lK«n+ll  X 
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I  7  6  ‘  — 1 

n  E.  ex'p{  E  T”m+  E  x 

i  *=  1  v  £  B7  m  =  1  n  *=  1 

exp  £  E  (7<-A»)*»+  E  (t.~  0)1+  E  hr-  0)  0  + 

(i*l  m*l  m  ■*  1  m  « 4 
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E  (^n.n+1)^X,n+1+  (A-  0)1  +  E  (A-  0)  0 
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.•Vs  in  the  additive  Rasch  case,  PME  item  parameter  gradients  are  the  same  as  their  MLE  counterparts 
(given  in  Jannarone,  1987),  whereas  individual  parameters  may  be  estimated  by  simply  augmenting 
MLE  sufficient  statistics  and  including  a  small  number  of  additional  0-valued  item  parameters. 


Summary 

An  easy  method  for  incorporating  prior  Bayes  information  into  Rasch-type  model  estimation  has 
been  described  in  this  article.  The  method  focuses  on  constructing  prior  probabilities  so  that  including 
prior  information  is  equivalent  to  augmenting  sample  data  with  artificial  data.  Consequently,  (a)  such 
prior  probability  structures  conjugate  likelihoods  with  resulting  posterior  distributions;  (b)  the  nature 
of  prior  belief  is  reflected  by  "prior  sufficient  statistic  values";  (c)  the  degree  of  prior  belief  is  reflected 
by  "prior  sample  sizes";  and  (d)  posterior  modal  estimation  entails  no  more  difficulty  than  maximum 
likelihood  estimation.  In  addition,  empirical  results  based  on  simulated  data  have  been  provided,  show¬ 
ing  that  the  method  removes  boundary  valued  sufficient  statistics  for  some  models.  The  simulated 
results  indicate  modest  improvements  in  Rasch  model  estimation  performance,  but  dramatic  improve¬ 
ments  in  Rasch  Markov  estimation  performance. 
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Caaa  125 

600  N,  Ovincy  Straat 
Art  mgtan,  VA  22217-5000 


da  a  >  at ant  far  Afl  fcaaeP»«*i 
UrUaaaaat  M  Studied 
OP  0197 

•ai«i«ttM,  OC  I03>0 

Or.  JvA •  t*>  (Ktaaav 
*far  Bataarak  laatrtvta 
5001  C>ta*N*»ar  *«anva 
Ai aaaafr i«,  VA  22)31 

Or.  Jacta  Orlanaly 
Inatitvta  far  Oafanaa  Anaiyaaa 
1601  N.  Baavrvgara  St. 

Aiaiaaar.a,  VA  22311 

Dr.  Rmaaipk  Park 
*  ray  Nttaarak  Inautvta 
SOC)  Eraaanaaar  Biva. 

Aiaaantr,.,  VA  ??>33 

aavna  N.  Pat ianca 

*n»rican  Caw"« « I  a«  Caveat 'en 

DID  lattmg  Sarvtca.  Sv«»*  20 
bn*  Dvaant  C>r«la,  NN 
naak mgtan,  DC  70036 

Dr.  Jaaaa  Pavlaan 
Daaartaant  af  Pavckalagv 
Part  I  ana  Stata  Umvaraity 
P.O.  Bat  751 
fartlanc.  Of  S72C7 

*a»mi itrat  i  va  Scivncaa  Dfpartaant 
Naval  Paateraavata  Scnaaf 
Mentar*,,  C*  33940^ 

Daaartaant  af  bparatiana  kaaaarck. 
Naval  Paatgrpavata  Bckaal 
MaMarav,  CA  93940 

Dr.  Mark  0.  Rackaaa 

ACT 

P.  0.  Baa  J66 
la-a  Crty,  1A  52243 

D* .  Hp ice ia  fca» 

b'aaka  A- t ,  7X  78235 

D-.  bam*  Riagaikavyt 
hvaARO 

1100  Bavtn  aaakmptan  Straat 
A.a.anar.p,  VA  22314 


Or.  Carl  fiata 
C*C»-«C» 

9«i iRipg  90 

_  §raat  itkaa  NTC,  U  60006 
-  Or.  J.  R*m  - 

Oap«rUa«t  #f  EAvcatipp 
.  Upivara*  ty  pf  BavtA  Cprpli 
CptaaBra,  OC  99700 

Or.  FiiarfcP  laa«jia« 
0apprt*aat  pf  Ppycdplppy 
LMtvpraity  pf  lanaaaaaa 
3100  AvatraPapy  Bidg. 

Napa vt I  la,  IN  37316-0900 

Nr.  Draw  Stall 
NPffOC  Cada  6? 

San  Diaga,  CA  92152-6600 

i aval  I  Sckaar 
Payckalcgical  ft  Cvantitati 
Faunaat tana 
Caliaga  af  Caveat • an 
Onivaraity  af  lava 
lava  City.  1A  52242 

Or.  Mary  &<krat| 

Navy  Paraannal  RftD  Crntar 
San  Diaga,  CA  92152-6800 

Dr.  Dan  Saga  1 1 

Navy  Paraannal  RftD  Cantar 

San  Diaga,  Ca  32152 

Or.  W.  Stava  Sallnan 
OASOIMRABU 
28269  Tka  Pantagan 
Naak mgtan,  DC  20301 

Dr.  Katva  9Niga*aav 
7-9-24  Kvpvftvaa-*.a  <  pan 
Fvyvaawa  251 
JAPAN 

Dr.  Uitlia*  Si*. 

Cantar  far  Naval  Analyaia 
4401  Far)  Avanva 
P.O.  Ba*  16268 
Alavanana,  Va  22302-0268 


i  Or,  n.  tul  lac  a  Sma-aa 
I  k»n»tvtr  Raaaarak 
■  ana  Adviaary  Sarvicaa 

•  Sditnaan.an  lnat>tvt<#n 
SCI  Nartk  Pitt  Straat 

]  Aiavanpr,*,  VA  223l4 

1  Dr.  Rickpra  E.  Wv 
|  DvpartnvM  af  PtvaPalagy 

•  Stanfvr*  Univariitv 

;  Stanford,  CA  94)06 

Dr.  R.cnard  Sa'anyen 

J  Navy  Par aanne (  R(D  Cantar 
t  San  D.aga,  Ca  32152-6600 

Dr.  Pavl  Saackaan 
Dnivvryity  af  *.||tv'' 
Draartve"?  af  Stati«t<ca 
Caiv^.a,  n\.  C5201 

Dr.  vH#T  Sp'av 
ACT 

p.e.  5..  Isa 

;#-a  Cl t»,  i*  52243 

D-  •  5tae*  .ng 

eavcatianai  Taatmg  Servie* 
Prmcatan,  Nj  0954) 

Dr.  f,ur  Stalaff 

Cantar  far  Navel  Ana<v»i« 

200  N*rtn  beaureyera  Straat 
Aitaanaria,  VA  223^1 
-r 

Or.  Will i an  Stawt 
Univera>ty  af  111  maia 
Deaartnant  af  Statistic* 

101  lilmi  Hall 
725  Soutf.  ariynt  St. 

Cnaneaigr.,  li  E1E2C 

D*.  ky  r  ■  ha  'an  5va»m*tn»n 

vaeeratvry  *f  P*vcnov«tric  are 
l va i vat • an  Aataarer 
Seneal  af  £ovcat>ar 
D«ivara,tv  ('  Mastaenvsatta 
*»n*r*;.  M*  C1CC2 

p#.  krai  Svnotar. 

Naw  Pa-aannal  RftD  Carta- 
San  O.egc.  CA  S2iS;-69D:< 


Or.  JaNn  Tangnay 
AF09N/NL 

Npltmg  Af 6,  OC  70332 
Dr.  Kikvsi  Tatavaka 


La»pratary 
UrP.na,  IL  61901 

Or.  Mawriaa  Tatavara 
220  Edve at • pn  B>ag 
1310  S.  S.atn  St. 

Cna*pp'fn,  It  6)920 

Or.  OtviA  Tpiaaan 
Dapartaant  pf  Pavakalagy 
Univaraity  pf  kanaaa 
. .  KS  66044 

M-.  Gary  Ihpaiaaaan 
Un  i  vara  .tv  af  1 1  I  ma  ■  a 
Edvaatianal  Pavcnaiagy 
Cnanpa.gn,  |L  61820 

Dr.  Rekart  Tavta«a«a 
On i vara i ty  af  Miatau-) 
Lfoa-tPtnt  af  Statiat.ca 
222  Mitk.  Sc • areas  8) eg. 

Ca iy*t ' a,  M3  £52! 1 

Dr.  Ladvarg  Tucaar 
On  ■  vara  i  ty  pf  lllmaiy 
OapprtMant  af  Pavcnpleg* 

603  E.  Daniel  Street 
Cnaapxgn,  1L  61020 

Or.  Varn  N.  Urry 
Paraannal  RftD  Cantar 
Offie#  af  Paraannal  Menaga««nt 
19X>  C.  Sfaat.  §• 

Naakmgten,  DC  204'.5 

Lr.  Davd  Vela 

assaaapmt  S»itr»r  Ce»t. 

2222  Univyryitv  *»#"«• 

Suit#  3!C 

St.  Paul,  Mr,  SCli* 

Dr.  -  -pn,  Vic  me 

Navy  Pe-sannci  PkD  Ca-tr* 

Sa-  D-age.  C*  22:5:-E9M 


0*.  Uni r*  Namar 
OiviaiP*  af  PavcNatp 
Edvcatianal  taatmg  i 
Prmcetpn,  NJ  00547 

Da.  M my -Mai  topng 
L  maaviat  Cantar 

far  Meaavrvnant  , 
Univaraity  af  lava 
Itvi  City,  1A  52242 

Or,  Uaaai  A,  taara  • 
Caast  Guard  laatitvl 
P.  0.  SuPstatian  ll 
On l anana  City,  Ok'  7] 

Dr.  Brian  Natars 
Pragrpa  Managar 
Mynyavar  Analysis  Pi 
NvnRRO 

1 IX  S.  Naskmgtaa  ! 
A.eaandr .a.  va  ;:3l- 

Dr.  Dav'4  J.  Halts 
NS60  C»1  mtt  Hell 
Un, varsity  af  Mmna 
7C  C.  R • va -  kty( 
r.nnaapalit,  MA  554 

D-  .  kanaif  A.  •  tr 
n’t,  Caaa  54n: 
Mpntaray,  CA  S2I52- 

My_)er  Jtkn  Nalak  , 
AfrWl/SGA*  > 

Brack •  ATB,  73  7022 

Or.  Oauglaa  Mattel 
Caaa  12 

Nyvr  Paraannal  RftD 
San  D<aga,  CA  SC’.S- 

Or .  Rand  P .  Ml  lea* 
Dnvar*  i  tv  a*  Saw*. 

Ca>  if  arum 

Laeartaart  cf  **•*« 
.at  Angaitt.  Ca  if' 


..  .'  ‘  wjr-ena-  - 


Garayn  Military  Rapraaantat iva *•* •  Or.  AntKany  R.  2ar* - 

ATIN*  Naif  gany  Mildagruha  -  '  Nat  i  ana  I  Cauncll  af  Stata 

.  >  StrsiUrsiftasat*-,-.  •  -••i,  Baard*  af  fti«r  a  lag,  la* 

0-5300  Naa»a  0  -  •*  - .  625  Nartk  M.ekiyan  Ava. 

-  aOOO  Brandywine  Straat,  9M  - -  Suita  1544  “  '  *.  * — 

Maak mgtan,  OC  7X16  Ckmaga,  !L  60611 

Dr.  ftrsti  Killim  _ 

Daaartaant  pf  Edvaatianal  ~  " 

PayaNalagy 

Univaraity  pf  111 inpia 
Ur Nana,  )t  61001 

Or.  Hilda  Umg 
¥K  er-iK 

7101  Cana ti tut ian  A*a  j 

Masking tan,  DC  704] 8 

Or.  Martin  F.  Mmfcaff 
Navy  Paraannal  P  ft  0  Cantar 
Ban  Diaga,  CA  92152-6600 

Mr.  Jakn  M.  Naif a 
Navy  Parppnnal  RftD  Cantar 
San  Diaga,  CA  32157-6800 

Dr.  Gaarga  hang 
Grnatat lat its  LaPvryt»rT 
Hwariyl  Slaan-Kattcr  mg 
Cancar  Cantar 
1275  tare  n.enu# 

Nav  Vark,  NT  1X21 

Or.  Hatlaca  Mulfack,  111 
Navy  Paraannal  060  Cantar 
“  San  Diaga,  CA  92152-6600 

Or.  Kantara  Yiaaatta 

Edvcatipnal  Taatmg  Service 

Baaaaaia  Rvad 

Prmcatan,  NJ  08541 

Dr.  Mandy  Ten 
C*&/Hc6reu  n> i i 
Del  Monte  Rasaarcr  Pa-* 

Mertarav,  C*  33?-4r 

&r.  Joseph  ^ .  Taung 
MeNa-y  a  Cagn,*«va 
Pracasaas 

Nat  i  any:  Bcmnce  -awnaetiar 
naak mgtan,  DC  2C55C 


; : •'  .13* 

Cti^CAJU 


Of.  t.  Darrall  0*«k 
Uam«r*ltf  ^ 


Ik.  !»ff» 

CHUi*  liit.M 
►.0.  Nl  lit 
fawa  City,  1A  52243 

Dr.  Rvtoarf  Mlin 

Ca4n  II 7  a 

M*4  LUtnUff 

*»•••*  Training  IvittM  ClAtlf 
0r)an4a.  ft  32010 

Dr.  Jmh  Algma 
(tomriiti  #f  fltriM 
(••Nivilli,  FL  32605 

Of,  Crling  0.  Andimn 
Oiyartmnt  »f 

Stw4i|itra*#«  (  7 

1455  C*MAM|<« 

0 £>fU« 

Or.  Eva  l.  Baker 
UCLA  C«*i*f  far  t*a  Study 
af 

145  «*•  r«  «*< I 

Un  t  vir  a  i  t  y  if  California 

L.«  Angela#,  CA  00024 

Or.  Isaac  Bijir 
Esucatienal  lasting  Sir*ie« 

Pr incttan,  NJ  06450 

Or.  HanucKa  Binntau* 

School  a f  Ccucatmn 
la)  Avia  Urn  varsity 
Taf  Aviv,  fiaut  Aviv  69976 

Israel 

Dr.  Arthur  S.  Blaiwaa 
Cat#  A#71 1 

Naval  Training  Svatma  Cantar 
Or l an#*,  F£  32813 

Dr.  Bruca  Blais# 

Oaf ana#  Hsnseutr  Data  Cantar 
550  Camne  £  I  Eater*. 

Suit*  200 

M*nt*r#y,  U  93S43-3231 


NOK 

•030  ta.U  Clin 

—  Uuaya,  U  a>»M  •  - 

C#t.  Are* Id  Bator tr  -  -  - 
Baal i a  Paystoeisgisak  Onto# r a **4 
la4r«tana|iHa  lalHtiitwt'w 
Avert  mr  Kmi»|i«  Astnd 
fcrvi jaatraat 
1)20  Brvaaaia,  BCitlUN 


Ur.  tovtoart  Braau* 

Ca#a  H-095R 

toaval  Training  Sreteaa  Cantar 
Or i a*4s,  fl  32013 

O'.  Piker t  Brannan 
AnaricaA  Callage  Tasting 
Pr*gr*n* 

P.  C.  (Mi  160 

City,  U  52243 

Or.  Lyia  D.  Brians! in| 

WR  Ca4a  UllSP 

BOO  North  OviAry  Strait 

Ar| mgtan.  VA  2221? 

tor.  jane*  to.  C«r«y 
Cannanaant  (G~P1£> 

U.5.  Cssat  Duard 
2100  Satan#  Street.  S.W. 
ksah  mgten ,  OC  2C593 

Or.  Jams  Ctrl  tan  * 

Anar ican  Catlaga  Tasting 
Pragryn 

P.O.  Baa  168 
lava  City,  1A  52243 

Dr.  J#hn  0.  Carrall 
409  E  Hiatt  tod. 

Cnastl  Hill,  HZ  27514 


Or.  (iaaart  Carrall 
OP  0167 

mthmgien,  DC  20370 

Hr.  toavmnd  C.  Ctor.stel 

AFMRL/KOC 

bnm  A?e.  T*  78235 


py.  Aar***  Cl»Tf 
Do*rk***t  af  PevaMlngy 
.  Utois.  •»  UUUftoito 
University  M 
Into  AagalMi  CA  tBOD? 

OlrsatsrJ’' 

masavar  S#»P#r'  •** 
Ptltlain  Prngrs# 
Cantar  far  *•••* 


Or.  Cel  War 

Off  ,cs  af  N#**t  UthnsUgv 


£.4e  2» 

000  N>  Ov»*«*  straat 
AMingtan.  VA  22ZP-5000 


Or.  Ha»t  C»n«ton0 
U«li*rtitT  »f  layAtn 
t  Avast  mn  Research  Center 

Beernaavelssn  t 

2334  CN 

He  NCTICA.ANDS 


Dr.  TinatAy  Devey 
C4««stmast  lasting  Service 
Prtncatsn,  NJ  06541 


Or.  C.  H.  Osytan 
Oassrtnant  af  N*#svr###nt 
Statistics  I  Ecatuatien 
Cal  lags  at  idvaatiSA 
Uni  vanity  #f  NsrylsA# 
Callata  Mrk,  W  *0742 

Or.  Bslpto  J.  DaAyaln 
H##svr*m«t.  Statiatica, 
and  £ velvet. an 
Bvnjamn  Bvi  I4mg 
Uni  varsity  af  H»r»  I  ml 
Cat ls%«  Park,  HO  207A2 

Or.  Oatt»rnis<  0*vgi 
Cantar  f*r  Nsvsl  Analyst* 
4401  F#r4  Avanva 
P.O.  Baa  1626B 
M*a%n#ri%,  VA  22302-0266 
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|k.  Nai-Ci  D*a* 

Ball  ta— «ai«at»»—  0aaa#r#to 
B  (ar»*rit*  Pl##to 
Py*-UZ2B 

piacstauey,  NJ  C30W 


Dr.  frit*  *•#*#• 
tM i varsity  a#  !»»#•••• 


Oafanta  Taatoniaal 

1*1  »rait>M  Cantar 
£*•*»#•  Btatinn,  B»#g  5 
tlaiwtni,  VA  2231* 
Alt#*  1C 
(12  Cnstaal 


)r.  Bteghan  DvAtosr 


Or.  Ja*at  A.  C*rlai 

Air  Pare#  MM4  Baanvnaa  Lato 

Break  a  APB,  U  78235 


Or.  Aset  Eaten 

Ar»y  Research  )nat«t«ta 

5001  Cmannawaf  A»anva 
Ala.angr...  VA  *2333 

Or,  JnM  N.  l44*#a* 
University  #7  |ttiP*»* 
252  Eng i nearing  Raeaarato 
Latoaratary 

103  Sauth  Nsttoewt  Street 

Ur»%nn,  ll  61B01 


Or.  Svtan  E«*rat*nn 
University  #7  Kansas 
Psyctostagv  Oaynrtmant 
•  426  faster 

Iterance,  KS  66045 


Or.  Casrga  Cnfl#to»r4,  Jr. 
Division  sf  C4vcat.ansf  Stv4*#« 
£«nry  University 
201  Fistokvrna  Bl#g. 

At  t  ants .  6A  30322 


Dr.  Banjanin  A.  F#«r»nnk 
Parfaraanca  Hatnsa,  Ins. 

5925  CaliagKan 
Suita  225 

San  An  tame,  TK  78228 

Dr.  Pat  F edifice 
Cade  511 
HP0QC 

Ban  Dings,  CA  92152-6900 

Dr.  Ieansr4  FaKt 
L  m#qu  i  at  Center 
far  toiaavnnant 
University  af  lava 
levin  City,  U  52242 

Dr.  Pithar#  L.  Fargvaan 
A#«r i can  Cm  lag*  Tatting 

Fr agr*« 

P.O.  bea  168 
lev*  City,  1A  52240 

Dr,  6trner4  Fi#ch#r 
L>*biggeaaa  5/3 
A  1010  Vianna 
AUSTRIA 

Dr.  Hyren  F  uchl 

Arviy  Rmirch  Institute 

5001  Etsmnvwer  Avenue 
Alaian#na,  VA  22333 

Pr*f.  Dina  Id  Fitsg*ral4 
Uni varyity  af  New  Eng  I  an# 
Dassrtnant  #f  Payatoalagy 
Ami4aia,  New  Sauth  heist  2351 
AUSTRALIA 

Hr.  Paul  Falay 

Navy  P*ra*nn*l  RIO  Cantar 

Sen  O.aga,  CA  S2152-6B00 


Or.  Naitt  6*77«r4  »•  • 
Univaraity  *7  NasaacMiBatt#^ ,  . 
5 ctoaaV  »f  £#w*lie* 

Annarat,  HA  01003 

Dr.  Rvtoart  61 tear 
kaarAing  RaanarnA  r- 
I  0**m*#nvat  Cantar 
Univaraity  #7  Pittakvffto 
3939  0*M#rt  Street 
Pittatonrgto,  PA  15260  , 

Or.  kart  fcraan 
Jatona  Hank  me  Univaraity 
Or aar tnmt  *7  Ptyeniligy 
Cnarli#  B  34tk  Street  , 

Belt. nan.  iC  21218 

Dial.  Pad.  Hithail  to.  Htean 
Univereitat  Dva*if«arf 
[ri ,  « l 

Univaraitataatr,  l 

D-400C  Dutaa I4nrf  1 
WEST  CCRHAHt 

Or.  toanat#  C.  Haakutan 
Pr*f.  af  £#v«ati*r  I  Pavcnaiagv 
University  af  Kaaaaenuaitt* 
at  Aatoerat 
Hilly  Havt* 
nanarat,  HA  01003 

Or.  Drivyn  H#rni#*K 
Univaraity  af  lllinait  . 

51  6arty  Oriva  J 
tnsneaign,  lL  61620 

Or.  Brant  Manning 
6*n i *r  toaaanrin 
Giviatan  nf  to***vraa*nt 
toaaaarato  and  Sarvuva 
Cdvcatinnal  lasting  Service 
Princatan,  NJ  08541 


Pref .  LtoU  T.  Narnk* 

lMlit.1  r.f.Ml.li. 

MIN  AnatovA 
jnafaratrnaa*  17/19 
D-5100  Anahvn 
WEST  6CTHAKY 

Dr.  P##l  Herat 
677  6  9tr#at.  41B4 
Ctovla  Vista,  CA  900J0 

Nr.  Dick  HaaNnw 
OP-135 

Art  iltftvn  Annaa 
R*m  2B34 

haato mgtan,  OC  20350 

Dr.  L Ivy 4  Hv«ator*y* 
Univaraity  af  II I inaie 
OisartMflt  nf  Paycnnlngy 
603  Cn»t  Daniel  Street 
Ch*«aai»n,  IL  61620 

Or.  Stavan  Munkt 

Ocaartnant  #7  Eautatian 
Univaraity  af  Al*#rta 
Cannntan,  Altoyrta 
Canada 

Dr.  Mwvnto  Mwynh 
Cal  lags  nf  Ccvcatinn 
Univ.  af  Sauth  Carali*# 
Caiuhfa.  SC  29208 

Dr.  Rakart  Jai»nar#n* 
DaaartMMf  af  Ptvyhaiayv 
Univaraity  af  Snvth  Carnlma 
C* iwnb i a,  SC  29209 

Dr.  Dennis  C.  Janningt 
Da»art«ant  af  5tat»«t»«a 
Univa-City  af  lll«nai» 

1409  Neat  6'**n  Street 
Urysna,  ll  £163! 
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Dr.  Alfred  fi.  »r*giy 

ArO$R/K. 

Bailing  APB,  DC  23332 

Or.  R*#tM  D.  6'Sbana 

III inaie  Slat*  Payahiatri*  Inat. 

to*  529# 

1601  N.  Taviar  Street 
Chi  cage,  ll  60612 


to*.  Lmtti  n»'.u' 

toavv  Paraann*'  RiO  Cantar 

C***  62 

S*r  Oirgt.  CA  9::£2-6800 

Or.  Paw*  h.  Mai  lane 
Edweat itnyl  Tasting  5*',**«* 
toeaaaaia  toaad  ' 
tor  me  « ten,  NJ  085#  1 


C».  Dauy'aa  H.  uama 
Tnatcmr  jan««  naeaciatvt 
P.t.  Bar  6640 
1C  Tr*«atga»  C*v'l 
u*vran**vi lit ,  KJ  0864b 


Copy  ovalloble  to  DTIC  doo#  not 
permit  fully  legible  reproductipp 


Dr.  Hi  I  tan  S.  Ktotl 
Ara^r  Rasa  arch  Inttitet* 

5001  E i eanhewar  Av*n«a 
Alcaansr.a,  VA  22333  1 

Praf.  Jaton  A.  Kaata 
&*aart**At  af  P*ycto#l#»y 
Univaraity  tof  h^Ksattn 
N.S.N.  2306 
AUSTRALIA 

Dr.  6.  Bay*  Kinyatoury 
Parties#  Pukli#  6«to*ala 

Riaaarck  an#  Ivaluatian  Ovnartwnt 
501  Narth  Oman  Straat 
P.  0.  Baa  3107 

Part  I  an#,  OR  97209-3107  | 

Or.  hi  1 1  in#  Kach  ' 

University  af  Tiaaa-Auatm  j 

tocaaurevint  an#  Ivnluat**" 

Center 

Avitm,  IX  76703 

Or.  jams  Utitt 
C*a>ogtir-toaa*4  E#ueati*n 

toieaarch  Lanaratary  , 

Univiraity  af  lllmaia 
Uream,  11  61B01  , 

Dr.  Laanar#  tomaiar 
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